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This paper is the first in the series devoted to evaluation ol the partition function in statistical 
models on graphs with loops in terms of the Berezin/fermion integrals. The paper focuses on a 
representation of the determinant of a square matrix in terms of a finite series, where each term 
corresponds to a loop on the graph. The representation is based on a fermion version of the Loop 
Calculus, previously introduced by the authors for graphical models with finite alphabets. Our 
construction contains two levels. First, we represent the determinant in terms of an integral over 
anti-commuting Grassman variables, with some reparametrization/gauge freedom hidden in the 
formulation. Second, we show that a special choice of the gauge, called BP (Bethe-Peierls or Belief 
Propagation) gauge, yields the desired loop representation. The set of gauge-fixing BP conditions is 
equivalent to the Gaussian BP equations, discussed in the past as efficient (linear scaling) heuristics 
for estimating the covariance of a sparse positive matrix. 

PACS numbers: 02.50.Tt, 64.60.Cn, 05.50.+q 

The series in general, and this paper in particular, belongs to the new emerging field of statistical inference and 
graphical models born on the cross-roads of statistical/mathematical physics, computer science, and information 
theory (see the following recent books as introductory reviews [2 13 |3]). A typical problem in the field can be 
stated as follows. Given a graph (trees, sparse graphs or lattices are the three most popular examples), finite or 
infinite alphabet with the variables defined on the graph elements (typically vertexes or edges) and a cost function 
(probability) associated with any given variables configuration, one should find the marginals, correlation functions, 
or solve the weighted counting problem (calculate the partition function). The main problems that define the field 
are: (a) to estimate the efficiency of exact evaluation for a typical or worst case problem for a class in terms of its 
dependence on the problem size; and (b) when an exact evaluation is not feasible, as it requires an unacceptably large 
number of steps, to suggest an approximation and a corresponding efficient algorithmic implementation. 

A powerful approach in the field of statistical inference is to build an efficient scheme based on a simple case 
or limit, where the evaluation is easy, i.e. complexity is polynomial in the number of variables. One simple case 
corresponds to trees, i.e. graphs without loops. Following the so-called Bethe-Peierls approach inspired by [H [S], 
one can show that the computational effort for the partition function on a tree is linear in its size. Furthermore, 
one anticipates that the tree-based methods and corresponding algorithms should perform reasonably well on sparse 
graphs with relatively few loops. This approach was reinvented and successfully explored in coding theory [B] (see 
e.g. [7] for a modern discussion of the graph-based codes) and artificial intelligence |Hj, where the corresponding 
algorithm was coined Belief Propagation (BP) and this name is now commonly accepted across the disciplines. In a 
recent development we suggested an approach, called Loop Calculus (LC) [9l[T0], which establishes an explicit relation 
between the BP (previously thought of as just heuristics) and exact results. Formally, LC expresses the partition 
function of a graphical model in terms of a series over certain subgraphs (referred to as generalized loops), where each 
individual term (that corresponds to a generalized loop) is expressed explicitly in terms of the BP solution (strictly 
speaking, a fixed point of the corresponding BP equations). LC, originally formulated for a binary alphabet, has been 
extended to an arbitrary finite alphabet in |llj . and the corresponding approach has been called the Loop Tower. 

There is also a class of problems that are easy in spite of a large number of loops contained in the underlying 
graphical structure. A so-called Gaussian Graphical Model (GGM) that belongs to this class is closely related to 
the subject of this paper. Consider a graphical model with continuous variables defined on vertexes of a graph with 
a Gaussian pair-wise interaction. The corresponding partition function, represented simply by a multi-dimensional 
Gaussian integral, is, therefore, reduced to evaluating the covariance (inverse) of the interaction matrix (note that this 
operation is well defined only if the matrix is positive definite) . For an arbitrary interaction matrix, expressed in terms 
of a dense graph, this is a problem of complexity, where N is the number of the graph vertices. However, as shown 
in [121 US] I one can also use a more efficient, linear in N, Gaussian Belief Propagation (GBP) algorithm for exact 
calculations of the marginals within the Gaussian continuous-alphabet model. The GBP can also be used for finding 
the covariance or evaluating the determinant of the interaction matrix. However, it does not give an exact result, but 
rather provide an approximation, which is conjectured to be a reasonably accurate heuristics at least for sufficiently 
sparse graphs. An intuitive (but also mathematically rigorous) explanation for the exactness of GBP in the case of 
marginals and its insufficiency for the covariance and related object has been given in via the so-called Walk-Sum 
Approach (WSA). WSA relates the exact result for the covariance to the sum over all possible oriented paths on the 
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graph, while GBP (strictly speaking asymptotic GBP, evaluated on an infinite computational tree) corresponds to the 
summation over a special sub- family of directed walks, specifically backtracking directed walks. This approach has 
also been extended to evaluate the partition function of GGM (related to the determinant of the interaction matrix) 
in [T5". The majority of these and other recent studies of GGM have focused on the analysis of the conditions for the 
Gaussian BP convergence [111 [TU (TBI [T71 [TSl [H] or practical implementations of the GBP algorithm pTl EU] , 

However, and in spite of this important progress and practical significance, a systematic analysis of the accurateness 
of GBP as an approximation and a possibility for systematic improvements of the GBP so far has been largely left 
unexplored. Even though we are still unable to provide the full answers, this paper reports some progress towards 
the future resolution of these important questions. 

In this paper we introduce a fermion-based version of the Loop Calculus approach of [9j [lOl [11] that provides an 
exact representation for a determinant as a finite loop series, where the first term corresponds to a fixed point of the 
GBP algorithm for the corresponding GGM (that we will also be calling a solution of the GBP equations, or simply 
GBP solution) . Each subsequent term of the Loop Series is associated with a loop on the underlying graph and is 
expressed explicitly in terms of the GBP solution. Our approach explores the power of the Berezin representation for 
a determinant in terms of symbolic integrals over anti-commuting Grassman variables |21l 122] . Note, that a relation 
between some binary graphical models on a planar graph and Grassman integrals was briefly discussed in j23j . In 
this and subsequent papers of the series i24j we take broader perspectives and do not limit our discussions to planar 
graphs. 

The paper is organized as follows. In Section [l] we start our discussion with an extensive introduction (reminder) 
to the Berezin integral approach, that will culminate in a Grassman integral representation for the determinant of 
the underlying correlation matrix. Section [ll] is split in three Subsections and forms the core of the paper. Gauge 
transformations that keep the partition function of the fermion model (the determinant) invariant are introduced in 
Section [II A| In Section |TTB] the Belief Propagation is interpreted as a gauge fixing condition. Section [II C[ finalizes the 
construction of the Loop Series. The manuscript also contains two Appendices. Appendix [X] is auxiliary to Section 
II C and contains some technical details of the Grassman integral calculations. Appendix |B] derives the BP equations 



for the standard (Bose) representation. Section III summarizes the results, briefiy discusses the relations between the 
results reported in this paper and other results and future directions, e.g. related to the second paper in the series 



I. INTRODUCTION: INTEGRAL REPRESENTATION 



We start with introducing a convenient integral representation for the determinant of an x matrix Hab that 
will allow to apply the Loop Calculus approach [U [10] to represent detiJ in terms of a finite loop series. Although 
formally the proposed scheme can be applied to any matrix, it becomes algorithmically practical in the case when the 
matrix H is sparse. 

We associate with our N x N matrix H a graph G{H) with A^ nodes a G Go- The nodes a and b are connected 
by edge a = {a,b} G Gi, where a ^ b, when Hab Oi or H^a 7^ 0. In other words the nodes a € Go represent the 
diagonal elements Haa, whereas the edges {a,b} G Gi, correspond to non-zero off diagonal matrix elements Hab and 
Hha- Hereafter we will also use a convenient notation a ^ b for {a, 6} € Gi- To avoid confusion we emphasize that 
{a, 6} naturally denotes a set that consists of (two) elements a and 6, i.e., {a, 6} G 2^° is a subset of the vertex set 
Go- In particular {a, 6} = {b,a}, which means that we are dealing with a non-oriented graph, and Gi C Gq denotes 
the set of graph (non-oriented) edges. The notation (a, 6) with a ^ b stands for ordered pairs, i.e. (a, 6) 7^ ib,a). 
Ordered pairs can be utilized to denote oriented edges (a, 6) G Go ^ Goi if we decide to choose an orientation on 
our non-oriented graph. Note that the sparseness of H means that the valences (degrees of connectivity at nodes), 
val(a) = card({& G Go{H)\b ~ a}), are small compared to A^. 

To develop a finite loop decomposition for the determinant we represent det H as a, Berezin integral over anti- 
commuting Grassman variables |21j . Specifically, we introduce a set {9,9} = {^a,^a}aeeo with a = 1,...,A^ of 
Grassman variables that anti-commute, i.e., 

Oadb = —dbOa, 9a6b — ~db6a, 9adb = —db&a, Vfl, feG^/Q- (1) 

A function F{9, 9) of the Grassman variables is understood as a Taylor series, which turns out to be finite since, due 
to the anti-commuting relations Eq. ^ , each term of the Taylor series can contain any component 9a or 9a not more 
than once. The Berezin integral is defined via the Berezin measure 



mm = Y[ d9ad9a, 



(2) 
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where the differential variables {d0a, d9a}aec;a anti-commute with each other and with the original Grassman variables. 
The Berezin measure is fully defined by the integration rules 

9adea = J9ad9a = l, J d0a ^ J d0a = 0. (3) 

For those who seek more rigorous definitions: We introduce a Grassman algebra Gr{Oo) as an algebra over M (or 
C) generated by {9a,9a}aego with the relations given by Eq. ([l]). A function F of Grassman variables should be 
interpreted as an element F £ Gt(Qq) of the Grassman algebra. The Berezin integral is a measure fi : Gt(Qq) — > M 
that associates with any element of the Grassman algebra(or simply a "function of Grassman variables" ) the value of 
its integral, according to the rules given by Eqs. ([2| and 

A well-known property of the Gaussian Berezin integrals, applied to our case, reads 

detH^ / I?0I?0e^°(«», So{6,e)=Y,Haa9a9a+ Hat9a0b- (4) 

According to Eq. ^ we interpret the determinant as partition function of a statistical fermion model defined on 
the graph Q, where the fermion (Grassman) variables reside on the graph nodes. To apply the loop decomposition 
we convert the resulting statistical model into a vertex model, i.e., the one with the variables residing on the graph 
edges. This task can be easily accomplished with the help of a Hubbard-Stratanovich (HS) type transformation, 
defined as follows. We introduce a set of Grassman variables {Xab,Xab}a,bego;{a,b}egij describing the HS decoupling 
field representing the off-diagonal terms in the action of Eq. Q . These variables express interaction of the original 
variables with the decoupling field. This is achieved by making use of the set of identities 

^HM+H,J,e^ ^ ^HabHtaJ dXabdXabdXbadXbae^"'''>" ^^''''- + ^"''^" ^'^^^^ 

X gX„Ja+x^aea+xa,S,+xa,e,^ Vla,^}^^^!, (5) 

where, for the sake of simplicity, we assume that, if a 6, both matrix elements Hab and H^a are non-zero. (The 
latter condition can be actually relaxed, however this goes beyond the scope of this manuscript.) Using the integral 
representation ([s]) for the terms that originate from the off-diagonal terms of the action 5*0 in Eq. Q we arrive at the 
following HS representation for the determinant 



detiJ 



&~a 

SHs{0,e;X,X) = ^i^aaMa+ ^ (HabV^ XabXba + ^^^'^^ + ^^aO a) ■ (6) 

As it always happens for the HS transformation, integration over the HS field in Eq. (|6| reproduces the original integral 
representation Q due to the identities ([s]). To accomplish the HS trick we integrate over the original variables {9, 9}. 
This can be readily done, since the integration is local (i.e., can be performed on each node independently). Finally, 
we arrive at the following desired expression for the determinant in a form of the partition function of a vertex model 



detH=Z=l U i-HabHba) ( n ) / n UXa,Xa) [] 5a(Xa,Xa) 



(7) 



where Xa = {X6a}6eeo-b~a is a set of edge variables attached to the node a, and Xa = {Xab, Xm} is the set of variables 
that reside on edge a = {a, b}. The edge functions 

5a(Xa,Xa) =5ab(Xa,Xa) - .9fca(Xc.,Xc.) =e(«-)"^-^- + (^-)"^-'^-, « = {a, &} (8) 

define the proper scalar products of the local states that belong to the same edge and different nodes. The vertex 
factor-functions are obtained via the local integrations described above 
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II. GAUGE TRANSFORMATION, BELIEF PROPAGATION AND LOOP SERIES 



This Section is broken in three Subsections. In Section II A we introduce a freedom (gauge) allowing to represent 
an edge (/-function as a sum of four terms each constituting a product of two vertex terms. Section [ll B| introduces a 
way of fixing the gauge freedom in accordance with the Belief Propagation Principle. We further derive the Fermi-BP 
equations which turn out to be fully equivalent to the (standard) Bose-BP equations discussed in Appendix Ib] The 



last Subsection II C culminates in a derivation of a finite Loop Series representation for the determinant, with each 
term of the series expressed explicitly via the solution of the BP equations. 



A. Gauge Transformation 



The (/-terms in the integrand of Eqs. ([t]) mix contributions associated with different vertices. Our next step will 
aim at the decomposing of the g-contribution at any edge into a sum of bi-local expressions. Specifically, we will be 
seeking for a decomposition of the following type: 



9ab 



2„b (^e''-^X..X..^7..X..X.. + ^^^e7;.X..X..e7Lx.oX.a^ + CabXabXba + CbaXbaXab, 



(10) 



with Kab = and Cab — Cba- AH the newly introduced parameters in Eq. (10 1 are to be defined by comparison 



with Eq. ([8|. Therefore, expanding Eq. ( |10| and Eq. (|8| into a series over the Grassman variables and comparing the 
results term by term one establishes the following relations for the coefficients entering Eq. (10 1 



Ca&(l + Kab) = 1, Tab + '«a67a6 = 0' 7ba + ^abTba = 0. Cab = (Hab) \ C,ba = {Hba) \ 

Cab{.lablba + l^abiabiba) = -{HabHba)~^ (11) 



The relations (111 allow all the coefficients to be expressed in terms of 70& 



l^ab 



abJ^balablbai Cab 



1 + Kafc 



iab = -(Kab) ^lab 



HabHbalba 



Cab = (Hab) 



(12) 



We call the freedom in choosing the 7 variables the gauge freedom, as any choice of 7 does not change the value of 
the partition function defined by Eqs. ( |7|8|9|10|12[ ). 

The gauge transformation, formally described above, utilizes a decomposition of the graphical trace over the vector 
spaces Vab, where each Vab is associated with the link {a,b} e Qi and node b e Qq: Vab represents the Grassman 
algebra generated by Xab and Xab- It has a super-dimension (2|2), i.e., an even dimension 2 (the first number) and 
odd dimension 2 (the second number), since it has 2 even states, namely 1 and XabXab, and 2 odd states, namely Xab 
and Xab- 

The skew-orthogonality conditions ( 10|12 1 are different from these we have introduced in the context of the finite- 
alphabet graphical models [HKinilll]. Indeed, since the local state spaces Vab with the super-dimension (2|2) have 
total dimension 4 = 2 -|- 2, a possible approach would be to build a tower hierarchy in the spirit of |llj . Then, a more 
general set of the skew-orthogonahty conditions (compared to those discussed above) should be introduced. However, 
the additional symmetry, i.e. the superstructure (strictly speaking it should be referred to as a Z2-graded structure) 
of the underlying linear algebra problem defines our choice of the more stringent skew-orthogonality constraint. The 
details of (and actual reasons for) the choice will become clear in the next Subsection when we discuss the additional 
BP constraints for the gauges. 

The gauge transformation results in an explicit representation for the whole partition function in terms of a series 
where each term corresponds to a choice of one of the four aforementioned states at each edge. The expansion is 
derived via a direct substitution of Eqs. ( 10|12[) into Eq. (|8|, followed by expanding the expression into monoms, 
substituting it back into the integrand of Eq. ([7| followed by the evaluation of the resulting integrals term by term. 
Each of the elementary integrals is vertex-local, thus turning the expression under evaluation into a product of simple 
vertex-related contributions. For any choice of the edge local parameters 7 one expects a gauge dependence of the 
individual contributions to the resulting series for the partition function, while the cumulative result (the entire sum) 
will be gauge insensitive/invariant by construction. 

In the following Subsection we discuss a special choice of the gauge, related to the BP approach, which essentially 
restricts all the contributions in the aforementioned series over the edge-states to those that correspond to generalized 
loops (to be defined later) on the graph. Note that another (non-BP) choice of the gauge that leads to an interesting 
explicit expression for the partition function of the monomer-dimer model as a finite series expansion over determinants 
(which is also a loop series of a kind, but in another sense) is discussed in the second paper of the series pij . 
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B. Belief-Propagation Equations 

In this Subsection we extend our general approach, coined Loop Calculus [HI [10], to the Grassman integral for the 
partition function (determinant) of the Gaussian model. 

We will impose additional constraints on the 7-gauges following two complementary approaches. First, we describe 
the BP gauge as a result of the ground state optimization. Then, we derive the same BP equations as a set of the 
no-loose-end constraints on the excited states. 



1. Variational derivation of BP equations 
The ground state contribution to the partition function (determinant) is naturally given by 



^0 = 



(13) 



where the dependence on the 7-gauges is spelled out explicitly. Since Eq. ( 13 ) interprets Zc as a Gaussian integral over 
the Grassman variables associated with vertex c, a direct evaluation of the integral results in Zc — det(Mc), where 
each element of the newly introduced matrix Mc is defined by M^^ab ~ [Hcc)^^ + ^bcSab- Evaluating the determinant 
explicitly one finds 



z, = det(Afe) = ( n la'A { 1 + (i?cc)-' ) ' 



and the resulting expression for the ground state contribution adopts a form 



' n (n-«(i+ (n-)) 

y{a,b}egi j XceGo \ a'~c / \a"~c / / 



(14) 



(15) 



Considering Zq^-j) as a 7-dependent approximation for the full partition function (by construction the latter does 
not depend on 7) one can define the BP-conditions as an adjustment of 7 that minimizes the dependence of Zq on it. 
Formally, one looks for a stationary point of ^0(7): 



Va € Qo and {a, b} E Gi 



dZn 



djab 



vbp 







-i^..i?.a7^'=i?..+i:(7^f)-^ 



'f ^ a' ^b 

Then, the actual value of the ground state contribution at the BP stationary point becomes 

TT TT (bp) (bp) / \ 

{a,6}eei ^abtlbalab Iba ^ ^ cEGo \ a'^c / 

where 7(^P) is defined implicitly by Eqs. (16 1. 



(16) 



(17) 



2. BP equations as no-loose-end constraints 



We reiterate that the gauge fixing boils down to a particular choice for the set of parameters {jab}a.bego;{a,b}GGi- 
This can be done by imposing an additional set of constraints that forbid the excited state structures with loose ends 
(more precisely nodes of valence one). Note that loose ends that correspond to odd local excited states are automat- 
ically forbidden due to the Z2-grading. Actually, this rationalizes our choice of the skew-orthogonality constraints 
in Eqs. ( 10|12[ ). Therefore, the BP conditions enforce a cancellation of a large set of contributions to the partition 
function. The forbidden contributions are those that contain loose end with even excited states at any vertex of the 
graph (while all other edges adjusted to the vertex being in the ground state). Formalization of the BP constraints 
results in 



Va e Go and {a,c} e Gi ■ j dXadXafa{Xa.Xa)e^'-''^^'^"-^"' 



b^c 

c) glba.Xba.Xba 



= 0. 



v(bp) 



(18) 
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The condition in Eq. (18) can also be restated as det{M'^^) 
replacing jca with 7^^ = Hac 



0, where the matrix M'^^ is obtained from Ma by 



/lac- Utilizing Eq. (14l we observe that Eqs. (I8I turn explicitly into Eqs. (I6I 



3. Brief discussion of BP equations 

In the two preceding Subsections the BP equations were derived in two different ways, via the variational and loose- 
end approaches respectively. Appendix |B] also contain a relevant information. It is shown there that the problem of 
finding the Fermi-BP-gauge (here we emphasize that BP conditions follow from the Grassman/Fermi formulation) is 
completely equivalent to finding a stationary point of the so-called Gaussian BP equations stated within the standard 
Gaussian integrals. We call the standard BP approach Bose-BP to contrast it with the Fermi BP discussed above. 

Note, that BP equations can also be stated as defining extrema of the so-called Bethe Free Energy functional, 
introduced for a general finite alphabet graphical model in [23], and also discussed in the context of the Gaussian 
(continuous alphabet) graphical model in [T5] . 



C. Loop Series for the Determinant 



The loop series is obtained in a standard way by considering local excited states that correspond to the choice of the 



second, third, or fourth term in Eq. (10). Therefore, each contribution to the correction for Zq determines a subgraph 



C C G that consists of the edges on which excited states have been chosen. Due to the BP equations a subgraph that 
provides a non-zero contribution does not have loose ends. Such subgraphs are referred to as generalized loops. To 
describe a contribution fully we partition the edges of C C G into the neutral ones that correspond to the choice of 
the even local excited states and the oriented edges that correspond to the odd local excited states. The choice of 
the third term in Eq. ( [To| will be denoted by an arrow on the edge {a, b} that goes from a to b, the choice of the 
fourth term is denoted by an opposite arrow that goes from b to a. The Z2 grading implies that in order to provide a 
non-zero contribution the number of incoming arrows coincides with the number of the outgoing counterparts for all 
nodes of C. 

We will further demonstrate that to provide a non-zero contribution each node of C can actually have no more 
than one incoming/outgoing arrow. This follows from the following form of the matrices inverse to Mc 



1 



for a^b (19) 



and to their modified counterparts M'^ obtained by replacing a certain number of 7a 
further make use of the properties of the Gaussian integrals and Eq. (19) to derive 



-terms with 7^^-terms. We can 



dXcdXcXacX6ce^"'-''~='*'-"'°''*"'=''"''= = (AC')a6det(M,)--(i/,,)-i J] 7a'e for fl ^ 6. (20) 
The property described above follows from the fact 



J dXcdXcXaic 



■ XakcXbic ■ ■ ■ XbkC^' 



= for {ai,...,afc}n{6i,...,6fe} = 0, fc > 2. (21) 



To prove Eq. (21) we apply the Wick's theorem that represents the Grassman integral in Eq. (21) as a sum of fc! 
contributions that correspond to fc! possible pairings between the x ^tnd x variables in the pre-exponents. Each 
contribution consists of a product of fc pair correlation functions given explicitly by Eq. ( 20 1 . Due to the form of the 
pair correlation functions, their product does not depend on a particular choice of the pairing. On the other hand, 
the signs in front of the contributions are alternating and the number of negative signs among the fc! contributions is 
the same as the number of positive signs, provided fc > 2. This leads to Eq. (21). For fc = 1 the (non-zero) result is 
given by Eq. (20). These results apply as well to the modified matrices M'^. 

We axe now in a position to summarize the results of Eqs. ( 19|20|2l" ) in the finite loop series expression 



det{H) - Z - %P;Fermi ^ 



ceGL(e) c'eDociC) 



(22) 



where GL{G) is the set of generalized loops of the graph G (subgraphs with all nodes of valence 2 or higher), and 
DOC{C) is the set of Disjoint Oriented Cycles (DOC) of the graph C, i.e., subgraphs of C whose all nodes have 



4.^ 4.^ 4 ^ 4^ 

4i> 4 ^ 4 ^ 4.A 
4i>. 4A 4 ^ 4-^ 

4i:^ 4J^4i>4.A 



4^ 4J^4.A<1 ^ 





FIG. 1: Example of the set of generalized loops for a sample graph, consisting of 6 vertexes and 7 edges. Generalized loops 
are shown in solid lines, while part of the original graph which does not belong to a generalized loop is shown in dashed gray. 
Oriented disjoint circles, which are also subgraphs of respective generalized loops, are marked with arrows and shown in red. 

the valence exactly 2, equipped with orientation. For a DOC C let deg(C") = card(7ro(C")) be the number of its 
connected components and for an edge a £ C[ let doa € Cg and dia G C'q be its left and right ends, respectively 
(orientation arrows go from the left to the right). A relative contribution r(C, C") can be represented as a product of 
the node factors ra{C,C'), edge factors ra{C,C'), and the parity factor: 

r{C,C')^{-lf-^^^'^ n raiC,C') [] (23) 

aeCo aeCi 

where the factors are calculated in a straightforward way (see Appendix |A] for the details) 

„ ,Y-a'eCorr „ (bp) v-a'eeo\Co/ (bp)^ 1 
a t Oo \ . — -r— , 



J^aa ^ Z^a'~al I a' a I 



aeCAC[: r^{C,C') = 

HcdHdcXd Tdc 
1-H -T-(bp) (bp) 

i:r_^^(bp) (bp) ^ ' 

where in the last two formulas c = doa and d — dia. 
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III. SUMMARY AND CONCLUSIONS 

The manuscript describes an explicitly constructed Loop Series for the Fermion Graphical Model. The LS expresses 
determinant of an arbitrary square matrix in terms of a finite series. Four important features of the series are: 

• The first term in the series corresponds to an approximation associated with solution of the GBP equations, 
identical to those that emerged in the standard GGM discussed before [Tl[Tl[Tl[TSl[Tni[T71[IHl[Tni[2D]. Note, 
however, that while the standard GGM approach would requires the matrix to be (at least) semi-definite (so 
that the normal variables Gaussian integral would converge) , our approach does not have this restriction as the 
Berezin integrals are defined for any (even zero determinant!) square matrices. 

• Each term of the Loop Series is associated with a generalized loop and an oriented disjoint cycle defined on the 
generalized loop. 

• Each term is expressed explicitly in terms of the chosen solution of the GBP equations. Computation of any of 
the contributions (once the GBP solution is known) is the task of linear complexity in the size of the underlying 
generalized loop. 

• The Loop Series can be constructed around any solution of the GBP equations, e.g., around these solutions that 
are unstable with respect to the standard iterative GBP. 

Let us now briefiy discuss how the fermion based Loop Series could potentially be used in the future. First of all, 
one hopes that the LS formula can clarify the accuracy of the GBP approximation for different classes of matrices 
(sparse, walk-summable, planar, etc.). Second, aiming to improve GBP one might be interested to identify problems 
(matrices) where accounting for a relatively small, 0{N^) with 7 < 3, number of loops, will significantly improve the 
GBP. In the context of these two general problems it will also be important to extend further analysis of the Bethe 
Free energy for the Gaussian models initiated in [13 US] . The Bethe Free energy is a functional whose stationary 
points coincide with the GBP solutions. 

Finally, let us briefiy overview the main idea of the second paper in the series [53], and its relation to the results 
discussed above. [23] describes a construction generalizing LS for determinant discussed in this paper. The construc- 
tion starts with a Z2-gauge theory, stated in terms of binary/Ising spins (that represent a gauge field with the discrete 
gauge group Z2) and fermions on an arbitrary graph. It is shown that, on the one hand, the graphical gauge model is 
reduced to a monomer-dimer model on the graph, while on the other hand it turns into a series over disjoint oriented 
cycles on the graph, where the corresponding coefficient is given by determinant of a matrix related to to the full 
graph with excluded disjoint. We find that this relation (between the monomer-dimer model and the Cycle Series) 
also follows (via a certain type of inversion) from the Loop Series for the determinant discussed in this paper. 
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APPENDIX A: BEREZIN GAUSSIAN INTEGRALS 

In this technical Appendix we present some details of the calculations of the node ra(C, C") and edge ra{C,C') 



factors for the relative loop contributions r(C, C") given by Eq. (24 1. We start with defining the Grassman variables 
correlation function 



= J dXcdXce^^'-"-^'^'-'^"^-'^''-"^=det{M,). (Al) 
The main feature of the Gaussian integral is expressed in the following Wick's theorem formula 



k 

{Xa,c ■ ■ ■ Xa,cXh,c ■ ■ ■ Xbuc)^^^ = ^(_l)dog(P) "Q (^a, ^Xp(6^ )c)^_^ , (A2) 

P i = l 



with the pair correlation function (XacXfec)^^ = [M^ ^)ab- Note, that Eq. (A2) follows naturally from a direct 



expansion of the following expression for the generating function 



x-x 



in powers of its argument. 

The Loop Series is obtained upon the substitution of the skew-orthogonality condition ( 10 1 into the integral repre- 
sentation ([?]) for the determinant that results in the following expression 

det(if) = Zgp.pgj.j^j + ^ ^ W_ HQga,diaHQ^a,doaZdoa,dxa{C,C') '^{-HaaZa{C,C')) (A4) 

C£GL(G)C'£SL{C)a£gi aeSo 

The quantities Zab{C, C) with a = doa, b = dia are determined by the coefficients in the skew-orthogonal represen- 



tation (10 1 and are given by 



ZaiC C) = Cab for a e ^1 \ Ci, z„(C, C) = for a£Ci\C[, z^{C, C) = Cab for a e C[ (A5) 



The explicit expressions are obtained by combining Eq. (A5) with Eq. (12 1. The quantities Zc{C,C') are obtained 



by attaching the functions of the local Grassman variables in ( 10 1 to the corresponding vertices followed by the 



10 



integration over the local Grassman variables. This results in 



c e Co \ : z,{C, C) - J dxcdxce^- '- K.^.Xa.x.. = det(Af^) 



c, s', s" e : C") = y dXcdXcXs-cXs-ce'^-''-' ^ det(Af^)(M^)-,V 

= -{HccY' n 7ac n ^Ic- 



(A6) 



The loop series (22 1 is obtained from the representation of Eq. (A4| with the ingredients given by Eqs. (A5l and (A6l 



by regrouping the factors into the node and edge ones in a very obvious way. 

Finally, we demonstrate that the vertices that have more than one incoming/outgoing arrow do not contribute to the 
determinant. Such contribution is proportional to (xaic ■ • ■ Xa^cXbic ■ ■ ■ Xbkc}^ ^ with {oi, . . . , Ofc} n {61, . . . , bj.} — 



and vanishes, since applying the Wick's theorem Eq. (A2) we derive 



P 



and the alternating sum over fc! permutations P in the numerator vanishes for k > 2. 



0, (A7) 



APPENDIX B: BELIEF-PROPAGATION GAUGE IN BOSE-REPRESENTATION 



In the normal (Bose) integral representation the determinant can be represented as follows 



aeGo 



(a,b)eei 



(Bl) 



where the integration goes over the pairs of the complex conjugated variables (normal c-numbers). Here, we restrict 
ourselves to the case when the integral is well-defined (convergent). To decouple the terms associated with different 
vertices of Go we introduce the following Bose-version of the HS transformation 



Hab 7 , - 
exp ^VaPb ^WbWa 



2 ^"-^^ 2 

X exp [iipba^a/^ + i(pbai>a/^ + iifiab^bf^^ + lifab'^b/'^) 



fr, \9rr rr / d(fabdfabd(fbad(pbaexp ^'fab'fiba ^^ba^ab 

[l-nyHabtlba J \ 2 2 



(B2) 



Substituting Eq. (^B2k into Eq. (Bll and performing the integration over the vertex variables -0 we arrive at the 



following Gaussian edge factor function formulation 



(deti/)-i = (27r)-2|ei| 



( n ) f n (-HabHba)-'] 



Fa iVa, fa) = exp ( - ( XI ) [ ^''''^ 



HZ' 



h: 



Ga (¥'a,¥'a) = exp ( -^^(^QbV'ba 



fbafab 



VCpV^ \{ Fa {'fa, fa) \{ G {fa: fa) ,(B3) 

(B4) 
(B5) 
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We further introduce the following gauge representation for the skew scalar product 



Ga = 0afc exp 



-^Vab^ab ^VbaVba 



Qab {.^ab,^ab)Qla ^Vba,^ba 



(B6) 



where (pab — 4>ba', the first term on the rhs of Eq. (B6 1 corresponds to the local ground state while the sum (remainder) 
represents some discrete spectrum of the excited states. The remaining freedom in Eq. (B6l is fixed via the following 
BP- (zero loose end) conditions 



V{a, 6} e ^1 : / V^faV^aFaiCpa. <fa) CXp (- 

•' \c~a ^ 



A. 



(B7) 



Multiplying Eqs. (B7) with Q^j^^ {^PbaiVba), making summation over all excited states (n > 0), and expressing the 
Q-terms via the ground state contribution (with the help of Eqs. (B6l), one arrives at the following BP relations 
stated solely in terms of the local ground states (local gauges) 



rc^b 



'^a,b £ Go, a ^ b : / VipaVipaFaifa, Va) W exp 



exp 



^-1 ^-1 

—-IpabVba T^VbaVab 



bab exp 



'Oab'-Pab^ J 'D(pa'D(paFa{(Pa,V>a) i Y[ CXp ^- 



Ac'a 



(B8) 



Evaluation of the Gaussian integrals transforms Eqs. (B8) into 

c^b 



ya,b EGo, ar^b: -XabHabHba = Haa + ^(Aca) \ 



(B9) 
(BIO) 



where the transformation from the Ihs of Eq. (BIO) to its rhs also involves Eqs. (B9l. The resulting BP expression 
for the entire partition function (BP expression for the inverse determinant) becomes 

Aba 



%P;B0Se = (2^)-'l^^l ( H ^aa J T)(paV^aFa (<^a, Va) exp ( - ^ 
n{Q,f,}eei (1 ^ (KbhaHabHba)^^) 



-'Pba'fiba 



n Mi-HabHba) 
da.b}eGi 



(Bll) 



Comparing Eq. (Bll ) with Eq. ( 17 1 we conclude that BP expressions in the Fermi- and Bose- cases are fully equivalent, 
i.e. 



%P:Bose ' %P:Fermi " 1- 



(B12) 



To summarize, we have shown in this Appendix that the Bose-BP equations of the standard Gaussian Graphical 
model, e.g., discussed in [13 HH [13 [HI [13 [HI [13 [20], are equivalent to the ones derived within the Fermi-BP 
approach discussed in the main part of the text. Moreover, the BP partition functions of the Fermi and Bose models 
are inversely proportional to each other. 

One final remark of this Appendix (and of the manuscript) concerns the reconstruction of the full expression for the 
inverse determinant from BP. The "ground state" part of the BP-gauge is fully defined by Eqs. ( B9|B10 l, however, a 
freedom in calculating the "excited state" gauges Q''"'' still remains. The Q*-"^ gauges can be fixed in the spirit of |llj . 
resulting in an infinite loop tower hierarchy for the inverse determinant. Note, that this infiniteness is in contrast with 
the finiteness of the Loop Series, built in the main part of the manuscript for the determinant of the same matrix. 
Here we do not discuss the Loop Tower reconstruction for the inverse determinant, leaving the question of possible 
relation between the aforementioned infinite and finite series open for future investigations. 



